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Abstract 

This paper focuses on an interesting phenomena when chaos meets computers. It is found that digital 
computers are absolutely incapable of showing true long-time dynamics of some chaotic systems, including 
the tent map, the Bernoulli shift map and their analogues, even in a high-precision floating-point arithmetic. 
Although the results cannot directly generalized to most chaotic systems, the risk of using digital computers to 
numerically study continuous dynamical systems is shown clearly. As a result, we reach the old saying that "it 
is impossible to do everything with computers only" . 

1 Introduction 

This paper focuses on an interesting phenomena when chaos meets computers. When some chaotic systems are 
realized in digital computers, their true long-time dynamics cannot be exhibited at all, even in a high-precision 
floating-point arithmetic. Although the results cannot directly generalized to most other chaotic systems, the risk 
of using digital computers to numerically study continuous dynamical systems is exposed. Actually, in ^ Chap. 
3], we have shown some more subtle dynamical degradation of generic piecewise linear chaotic maps realized with 
fixed-point finite precision in digital computers. Although the phenomena discussed in this paper is completely 
different from those studied in ^ Chap. 3], the essential reason of both cases can be attributed to the use of the 
multiplication factor 2 and its powers. Why is 2 a magic number? It is because all digital computers are based 
on binary arithmetic, in which a multiplication with 2 J is equal to the left bit-shifting operation <C i, which may 
eat i' < i precision bits in each digital chaotic iteration if there does not exist a bit-compensation operation in the 
chaotic equation. 

Two well-known piecewise linear chaotic maps, the Tent map and the Bernoulli shift map, are studied in this 
paper. It is rigorously proved that all chaotic orbits of the two maps will converge to zero within a limited number 
of iterations, and that the average and maximal numbers of iterations to reach such a convergence are uniquely 
determined by details of the involved digital arithmetic. In addition, it is found that the average number is generally 
much smaller than the maximal one, when the initial condition x(0) distributes uniformly in the space of all valid 
floating-point numbers. The results on the Tent map and the Bernoulli shift map can be directly extended to other 
analogue chaotic maps, including the V-map f(x) — 2\x — 0.5, the reflected Bernoulli map f(x) = 1 — (2x mod 1), 
and the Baker map (considering Bernoulli shift map is the ^-transformation of the Baker map) Note that the 
case of the Bernoulli shift map (also called doubling map) has been well-known to chaos community but the 
case of the Tent map not yet. In fact, even for the Bernoulli shift map, there does not exist a quantitatively analysis 
on the long-time dynamics of the map evolving in digital computers. We hope this paper can help to clarify some 
questions. 

2 Real Numbers in Digital Computers 

As we know, digital computers adopt binary format to represent numbers. For real numbers, there are two kinds 
of representation formats: fixed-point format, and floating-point format. The fixed-point format is more suitable 
for integers or real numbers with a fixed precision, and the floating-point format is suitable for real numbers with 
a higher and variable precision. Accordingly, there are two kinds of digital arithmetic techniques. Because most 
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simulation softwares of chaotic systems use floating-point arithmetic, we will not discuss fixed-point arithmetic 
in this paper. Actually, for the problem studied in this paper, the condition under floating-point arithmetic is 
much more complicated than that under fixed-point arithmetic, and the major results can be easily extended to 
fixed-point arithmetic. 

In today's digital world, the floating-point arithmetic has been standardized by IEEE and ANSI in 1985 4 , 
and almost all software and hardware implementations of floating-point arithmetic obey this standard to represent 
the real numbers. In the IEEE/ANSI floating-point standard, two different floating-point formats are defined: 
single-precision and double-precision. The single-precision format uses 32 bits to represent a real number, and the 
double-precision format uses 64 bits. To realize a higher simulation precision, generally double-precision is used 
for the study of chaotic systems. Thus, this paper will focus on double-precision floating-point arithmetic, and 
briefly call it floating-point arithmetic. Note that the extension from double-precision floating-point arithmetic to 
single-precision arithmetic is very easy. 

Following the IEEE/ ANSI floating-point standard, almost all real numbers are stored in the following normalized 
format: 

exponent 
mantissa ^ ^ 

(-1) 663 x (Tb^~b^) 2 x 2^2 • ■ • b 52 h ~ 1023^ ^ 

where (-)2 means a binary number and (651 • ■ • 60)2 is called the fraction of the mantissa. There are five types of 
special values that are not represented in the above normalized format: denormalized numbers, ±0, ±00, indetermi- 
nate value, NaN (Not a Number), among which ±0 can be considered as two special denormalized numbers. Note 
that +0 ^ —0 and +00 ^ —00. The five types of special values are stored in the following formats HJ|3]: 

• denormalized numbers: when all exponent bits are zeros, i.e., &62 = • • • = fo 52 = 0, the floating-point number 
does not yield Eq. Q), but represents the following fixed-point number: 

(-l) b ».(0.6 51 ...6 ) 2 x 2- 1022 . (2) 

Apparently, denormalized numbers can be considered as fixed-point numbers whose absolute values are lower 
than the minimal positive normalized number (l x 2 1-1023 = 2 _1022 J. 

• ±0: the reason that denormalized numbers are used is the existence of the hidden 1-bit in the normalized 
format, which makes it impossible to represent zero. With the denormalized format, the representation of 
zeros becomes natural: b^ 2 = • • • = &o = 0, and ^63 serves as the sign bit. 

• ±00 are represented as follows: 6 62 = • • • = & 52 = 1, b 5 i = ■ ■ ■ = b = 0, and £> 63 is used to denote the sign. 

• NaN (Not a Number) can be represented with all other invalid formats, which include a) QNaN (Quite NaN): 
&62 = • • • = b 52 = 1 and (0 • • • 01)2 < (651 • • • 60)2 < (01 ■ ■ • 1) 2 ; b) SNaN (Signalling NaN): b 62 = • • • = b 52 = 1 
and (10 •••0)2 < (651 •••60)2 < (11- ••1) 2 . 



3 The Studied Chaotic Maps 

In this paper, two well-known discrete-time chaotic maps are studied to show the incapability of digital computers: 
the Tent map and the Bernoulli shift map 0- The Tent map is defined as 

/W = 1-2|* -0.5| -{£ lj*<£ (3) 

I 2(1 — x), 0.5 < x < 1, 

and the Bernoulli shift map is defined as 

!2x, 0<a;<0.5, 

2x -1, 0.5<x<l, (4) 

0, x = l, 

which are shown in Fig. and^D, respectively. 
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a) the Tent map b) the Bernoulli shift map 



Figure 1: The Tent map and the Bernoulli shift map 

As we know, the two simple chaotic maps have typical chaotic dynamics 1) positive Lyaponuv exponents; 

2) ergodicity, mixing and exactness; 3) uniform invariant density function f*(x) — 1; 4) the Tent map's auto- 
correlation function Tt(n) = S(n), and the Bernoulli shift map's auto-correlation function tb(ji) approaches to zero 
exponentially as n — > oo. The third property means that the chaotic orbit starting from almost everywhere will lead 
to the same uniform distribution f*(x) = 1 over the definition interval [0,1]. However, as shown below, this paper 
points out that such a good dynamics cannot be exhibited in digital computers well, due to the finite-precision 
effect. 



4 Chaotic Maps under Floating-Point Arithmetic 

Firstly, assume the initial condition a;(0) = (O.6162 ■ ■ - bj ■ ■ ■ b^-ib^i 7^ 0, where &l = 1 (the least significant 1-bit) 
and 1 — x(0) = (O.b^b^b^ ■ ■ ■ b[ } • ■ • • b'j j _^b£)%. Then, the iteration of the Tent map will be 

(2x(0) = x(0)<^l = (0.b 2 ---byb L _ 1 b L ) 2 , 0<a:(0)<0.5, 
[2(l-x(0)) = (b[.b 2 b' 3 ---b' j ---b' L _ 1 b L ) 2 , 0.5 < x(0) < 1, 

where <C denotes the left bit-shifting operation. Note that b\ — when < x(0) < 0.5. Apparently, after L — 1 
iterations, x(L — 1) = (0.6t)2 = (0.1)2- Then, x(L) = 1, and x(L + 1) = 0. That is, the number of required 
iterations to converge to zero is N r = L + 1. Note that N r = when x(Q) = 0. 
For the Bernoulli shift map, we can similarly get 

ar(l) = 2x(0) mod 1 = s(0) < 1 = (0.6 2 6 3 ■■■by b L -ib L ) 2 . (6) 

Apparently, after N > L iterations, x(N) = 0. That is, the number of required iterations to converge to zero is 
N r = L. Note that N r = when x(0) = 0. 

From the above analysis, it is clear that no any quantization error is introduced in the digital chaotic iterations, 
which is because the chaotic iterations can be exactly carried out with the digital operation <C. 

In the following, let us consider the value of L in two different conditions of x(0) ^ 0: 

e-l 

• x(0) is a normalized number: from Eq. |T|. a;(0) = (1. 651 ••■ 60)2 X 2~ e = (0. • • • 1651 • • • 60)2- Assuming 

e-l 52-j i 

the least 1-bit of x(0) is &, = 1, one can immediately get x(0) = (0. • • • 1 651 ■ • ■ 6, (J— ^0)2 and deduce 
L = (e - 1) + 1 + (52 - i) = e + (52 - i). Considering 1 < e < 1022 and < % < 51, 2 < L < 1074. 
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• x(0) is a non-zero denormalized number: from Eq. x(0) = (O.651 • 

Assuming the least 1-bit of x(0) is b. L = 1, one can immediately get a;(0) = (0.0 
deduce L = 1022 + (52 - i) = 1074 - i. Considering < i < 51, 1023 < L < 1074. 

To sum up, in both conditions L < 1074. 

In the following, we will prove that the mathematical expectation of L is only about much smaller than 1074 
if x(0) distributes uniformly in the space of all valid floating-point numbers in [0,1]. That is, the mathematical 
expectation of N r is much smaller than 1074 for the Bernoulli shift map, and smaller than 1075 for the Tent map. 

Firstly, let us consider the mathematical expectation of i 6 {0, • • • ,51}. Without loss of generality, for a 

denormalized number or a normalized number with a fixed exponent e, assume the mantissa fraction (651 • • • 60)2 

distributes uniformly over the discrete set {0, ■ • ■ , 2 52 — 1}. Then, the probability that (bi — 1, = • • • = bo = 0) 

2 51 ~ l 1 . . .1 

is ^ 52 = +1 , and the probability that (651 = • • • = 60 = 0) is Then, the mathematical expectation of i is 

8=0 1=1 V ' 

Then, let us consider the mathematical expectation of e G {1, • • • , 1022}. From the uniform distribution of x(0) 
in the interval [0,1], one has the probability of the exponent is e is about Prob[2~ e < x < 2~ ( - e ~ 1 ^} = 2~ e . Thus, 
the mathematical expectation of e is 

e—l 

From the above deductions, we can immediately deduce 

E{L) = Prob [normalized numbers] • (E(e) + (52 — E{i))) 

+ Prob [denormalized numbers] • (1074 — E(i)) 
1022 1 

= l^-^ + ( 52 -^ + Kr23-( 1074 -^ 
1022 1 

- 1023 • < 2 + ^ ~ W + 1023 •( 1Q74 - 1 » 
1022 1 

= 1023 ' 53 + 1023' 1073 
1020 

= 53 + 1023 " 53 -" 7 - 

Generally denormalized numbers will not be used by most pseudo-random number generators, such as the embedded 
rand function in almost all programming languages, so E{L) = E(e) + (52 — E(i)) w 53. That is, E(N r ) w 53 << 
1074 for the Bernoulli shift map, and E(N r ) w 54 << 1075 for the Tent map, where a << b means that a is much 
smaller than b. 



5 Experiments 

To verify the analysis given in the last section, a larger number of floating-point numbers are tested for the two 
maps. Taking the Tent map as an example, the results of three typical numbers, the minimal denormalized number 

63 10 52 52 

x(0) = (0^01)2 = 2- 1074 , and a normalized number x(0) = (0| (T^0 1| T^~l) 2 = (l.T— T) 2 X 2" 1022 are given 
in Figs. [2]and|21 respectively. 

To verify the mathematical expectation of N r , some experiments are made for test on 1000 initial conditions 
pseudo-randomly generated with the standard rand function of matlab. The values of N r corresponding to the 1000 
initial conditions are shown in Fig. and the occurrence frequency of different values is shown in Fig. El Following 
the data, we can get the average of N r is about 54.03 « E(N r ), which agrees with the theoretical result well. 
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Figure 2: The evolution of the digital Tent map with the initial condition x(0) = 2 
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Figure 3: The evolution of the digital Tent map with the initial condition x(0) — (1.1 • • ■ 1)2 x 2 
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6 Conclusions 

This paper studies the digital iterations of the two well-known chaotic discrete-time maps - the Tent map and the 
Bernoulli shift map. It is found that all chaotic orbits will be eventually converge to zero within N r iterations, and 
that the value of N r is uniquely determined by the details of digital floating-point arithmetic. Although the given 
results are rather simple from a computer scientist's point of view, they really touches the subtle kernel of digital 
chaos (i.e., chaos in computers). 
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Figure 4: The values of N r for 1000 randomly-generated initial conditions 
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Figure 5: The occurrence frequency of different values of N r in the total 1000 values 
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